December 14, 2017

#install.packages(c("knitr", "rmarkdown"))
knitr::opts_chunk$set(fig.width=12, fig.height=8) 
library(dplyr)
library(mosaic)
library(tidyverse)
library(readr)
library(ggplot2)
library(scales)

The recently released $300 million budget DC superhero movie Justice League experienced a huge failure in terms of audience reviews - No mentioning a huge bunch of critic articles call it “a mess”, the film received a 41% on rotten tomatoes. One of the reason of the flop is the conventional plot and featureless characters of the superheros just bored the audience. If this movie was on screen back to 1960s, this kind of simple plot of the good guys defeating the vicious bandit and protecting the planet is enough to attract audience. However, the society has changed, and people are now looking for more interesting story with deeper meaning and more humanized heros.

Justice League

Justice League

How could DC not seen that? The decline of Western movies since the 1970s tells us that the production of movies should follow the trait of social change. The statistical data showed that the production of the Western movies peaked in 1910 to 1030, when the themes of Western movies well reflected the contemporary change of the American society. After 1980, as the social topic changed, Western movies were still constrained to the old theme, the popularity experienced a rapid declination. In the recent decades another peak appeared in Western movies production since the movies again fit the public demand.

Western_1120 <- read_csv("~/SDS192_mp4/Western_1120.csv")
peakWestern <- Western_1120 %>%
  filter(production_year<=2015) %>%
  filter(production_year>=1900)%>%
  group_by(production_year) %>%
  summarize(number = n_distinct(movie_id)) %>%
  arrange(desc(number))

knitr::opts_chunk$set(fig.width=10, fig.height=6)
peakWestern %>%
  ggplot(aes(y = number, x = production_year)) +
  geom_bar(stat = "identity") +
  scale_x_discrete(breaks = c(1900, 1910, 1920, 1930, 1940, 1950, 1960, 1970, 1980, 1990, 2000, 2010)) +
  labs(x = "Production Year", y = "Number of Western Movies", title = "Number of Western Movies Between 1900 and 2015") + geom_bar(data = subset(peakWestern, number == max (number)), aes(x = production_year, y = number), fill = "red", stat = "identity") +
  geom_text(data = subset(peakWestern, number == max (number)), aes(x = production_year, y = number, label = production_year), hjust = -0.2) +
  theme(plot.title = element_text(hjust = 0.5)) +
  geom_bar(data = subset(peakWestern, number == min (number)), aes(x = production_year, y = number), fill = "blue", stat = "identity") 

Over time, westerns have been redefined, reinvented and expanded to reflect the changes in the American society. As film critic Agresta Agresta commented, the themes of Western movies shift over time in accordance with America’s social movements. From the end of 19th century to early 20th century, the Civil War(1860-1865), Industrial Revolution (1870-1914), and the Mexican Revolution (1910) had resulted in reform in social organization and reconstruction of social classes (Hoberman, 2003). As these movements triggered people’s interests about the conquest of nature and the confiscation of the territorial rights of the original inhabitants, Westerns correspondingly started to often set on the American frontier, the borderline between civilization and the wilderness. Often the hero of a western meets his opposite ‘double,’ a mirror of his own evil side that he has to destroy in either the societal or the familial setting – complex with friends, relatives, and lovers of both White American and Native American.

IMDb database reveals the historical trend of western movies. During 1907-1917, top keywords of western films are indeed mainly about conflicts happened within family or wilderness settings. Top keywords about family drama include “extramarital affair”, “brother shoots brother”, “loss of friend”, which suggest that the films’ plots are closely related to the conflicts people witness in ordinary lives. Just by reading the film titles - Three Friends, Calamity Anne’s Beauty, and Broken Ways, the audiences can expect familial conflicts in the films. The top keywords about disputes in the wild include “face-sitting” (18 times), “woods” (4 times), and “fugitive” (3 times), suggest fighting scenes and violence in the wildness occurred frequently in the Western movies. Movies such as An Indian’s Loyalty and The Accusation of Broncho Willy both feature fighting scenes in the wilderness and the protagonist proving their innocence. The setting of Western movies reflects people’s attention to the personal and property conflicts taking place in the West, which is rouse by Mexican Revolution at that period.

options("scipen"=999, "digits"=4)
Western_decade <- Western_1120 %>%
  mutate(decade = cut(as.numeric(production_year), seq(from = 1950, to = 2010, by = 10), dig.lab = 5,  include.lowest = TRUE, include.highest = FALSE)) %>%
  filter(decade != 'NA')%>%
  group_by(keyword, decade) %>%
  summarise(number = n())%>%
  filter(number >= 3)

# install.packages("DT")
library(DT)
datatable(Western_decade, option = list(pageLength = 5))

Nevertheless, many film critics attribute the decline of the Western movies in the 1970s to the Vietnam War. Hoberman once noted that the ugliness of the conflict rendered the often blindly patriotic tone of the western obsolete (Hoberman, 2003). Vietnam-era westerns films like Stagecoach and High Noon show the difficult process of extending a young nation into new territory. Perhaps that’s why westerns resonate less and less since precious few among us would still call America a country on the rise. In addition, the cowboy has been gradually replaced by the superhero as the most common expression of American values in blockbuster filmmaking.

library(mdsr)
library(RMySQL)
db <- dbConnect_scidb(dbname = "imdb")
Superhero_1213 <- db %>%
  dbGetQuery("SELECT title, production_year, title.id, title.phonetic_code FROM imdb.title
Join keyword ON title.phonetic_code = keyword.phonetic_code
WHERE keyword = 'Superhero'
ORDER BY production_year, title;")
library(dplyr)
library(mosaic)
library(tidyverse)
library(readr)
library(ggplot2)
library(scales)

Superhero_1213 <- Superhero_1213 %>%
  filter(production_year<=2015) %>%
  filter(production_year>=1950)%>%
  group_by(production_year) %>%
  summarize(number = n_distinct(id)) %>%
  arrange(desc(number))
Superhero_1213 %>%
  ggplot(aes(y = number, x = production_year)) +
  geom_bar(stat = "identity") +
  scale_x_discrete(breaks = c(1950, 1960, 1970, 1980, 1990, 2000, 2010)) +
  labs(x = "Production Year", y = "Number of Superhero Movies", title = "Number of Superhero Movies Between 1900 and 2015") + geom_bar(data = subset(Superhero_1213, number == max (number)), aes(x = production_year, y = number), fill = "red", stat = "identity") +
  geom_text(data = subset(Superhero_1213, number == max (number)), aes(x = production_year, y = number, label = production_year), hjust = 1.2) +
  theme(plot.title = element_text(hjust = 0.5)) +
  geom_bar(data = subset(Superhero_1213, number == min (number)), aes(x = production_year, y = number), fill = "blue", stat = "identity") 

While Western’s golden age is gone, superhero movies become more and more popular starting from 1970s. In fact, we might attribute the decline of Western movie to the increasingly popular Superhero movies. From the 1978 Superman movie starring Christopher Reeve to the 2017 Justice League, superhero movies have never lost its audience. Movie-goers like to hear the simple story of the good defeating the bad and go home with a happy ending. This pattern has already been very successful in the last century during the heyday of Western movies, and now it is Superhero movie that satisfying this everlasting audience appetite. Many superhero movies are actually based on characters in DC and Marvel comic books dated back in the 1950s. The audiences of superhero movies are not just teenagers who dream to possess some superpower and save the planet, there are also adults who are excited to see their childhood heros in motion pictures. Thanks to the establishment of Marvel Studios, the number of movies that are tagged ‘superhero’ in the IMDB database is increasing rapidly since 2000.

Brokeback Mountain

Brokeback Mountain

Since early 21th century, western films had been trying to mount a comeback and reached its second peak in 2010. As shown in the IMDb database, the keywords associated with Western films are much more diverse and less concentrated on violent and conflictuous scenes. From 2005 to 2015, the keyword “American secret service” appears 6 times in Western movies’ database, and it shows that Western movies are incorporating detective elements from the rising popularity of detective films.

Instead of depicting the conflicts between civilization and savage wilderness, new era western films, such as Brokeback Mountain (2005), is exploring homosexuality theme that fits American popular culture. Different from traditional Western movies where right and wrong are easily distinguishable, Revisionist Western films such as Quentin’s Django Unchained (2012) and The Hateful Eight (2015) depict a moral ‘grey’ area where hero and villain resemble each other. The audiences are not told by the film producers explicitly who is righteous and who is the bad guy that they should hate. Rather, the audiences are encouraged to form their own observations and make their judgement based on each characters’ unique personal history and the changing environment. Thus, the “post-western” is trying to offer audience a cathartic space to look for answers.

If we look at the rise and decline of Western movies in the past century, we can see that good films always reflect on the social changes and public opinions of its time. Sticking with a popular yet stereotyped plot will not pique the audience’s interest, and this trend will lead to the decline of a genre. Perhaps that is what Superhero movie producers learn from the Western1.


  1. https://github.com/ArthiiNW/SDS192_mp4_zhl.git